Biases in Large Language Models: Origins, Inventory, and Discussion

نویسندگان

چکیده

In this article, we introduce and discuss the pervasive issue of bias in large language models that are currently at core mainstream approaches to Natural Language Processing (NLP). We first data selection bias, is, caused by choice texts make up a training corpus. Then, survey different types social evidenced text generated trained on such corpora, ranging from gender age, sexual orientation ethnicity, religion culture. conclude with directions focused measuring, reducing, tackling aforementioned bias.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Behavioral Finance Models and Behavioral Biases in Stock Price Forecasting

Stock market is affected by news and information. If the stock market is not efficient, the reaction of stock price to news and information will place the stock market in overreaction and under-reaction states. Many models have been already presented by using different tools and techniques to forecast the stock market behavior. In this study, the reaction of stock price in the stock market was ...

متن کامل

Large Margin Neural Language Models

Neural language models (NLMs) are generative, and they model the distribution of grammatical sentences. Trained on huge corpus, NLMs are pushing the limit of modeling accuracy. Besides, they have also been applied to supervised learning tasks that decode text, e.g., automatic speech recognition (ASR). By re-scoring the n-best list, NLM can select grammatically more correct candidate among the l...

متن کامل

Large Margin Neural Language Models

Neural language models (NLMs) are generative, and they model the distribution of grammatical sentences. Trained on huge corpus, NLMs are pushing the limit of modeling accuracy. Besides, they have also been applied to supervised learning tasks that decode text, e.g., automatic speech recognition (ASR). By re-scoring the n-best list, NLM can select grammatically more correct candidate among the l...

متن کامل

Metasignaling and Language Origins

Over the past two decades, comparative linguistic anthropological research has disclosed the significance of metadiscourse and metasignaling for the establishment, maintenance, and transformation of social relations. One type of metasignal-signal relationship has, because of its role in producing sociability, come to seem especially interesting with regard to the evolutionary origins of human l...

متن کامل

Learning biases and language evolution

Structural hallmarks of language can be explained in terms of adaptation, by language, to pressures arising during its cultural transmission. Here I present a model which explains the compositional structure of language as an adaptation in response to pressures arising from the poverty of the stimulus available to language learners and the biases of language learners themselves.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Data and Information Quality

سال: 2023

ISSN: ['1936-1963', '1936-1955']

DOI: https://doi.org/10.1145/3597307